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Abstract 

Potential games form a class of non-cooperative games where unilateral improvement dynamics 
are guaranteed to converge in many practical cases. The potential game approach has been applied to a 
wide range of wireless network problems, particularly to a variety of channel assignment problems. In 
this paper, the properties of potential games are introduced, and games in wireless networks that have 
been proven to be potential games are comprehensively discussed. 

Index Terms 

Potential game, game theory, radio resource management, channel assignment, transmission power 
control 


I. Introduction 

The hroadcast nature of wireless transmissions causes co-channel interference and channel 
contention, which can be viewed as interactions among transceivers. Interactions among multiple 
decision makers can be formulated and analyzed using a branch of applied mathematics called 
game theory lICTI . [I131II . Game-theoretic approaches have been applied to a wide range of 
wireless communication technologies, including transmission power control for code division 
multiple access (CDMA) cellular systems [I153II and cognitive radios [I132II . For a summary of 
game-theoretic approaches to wireless networks, we refer the interested reader to IfMl . ll^ . [l92l . 
[11081 . [I1681 . Application-specific surveys of cognitive radios and sensor networks can be found 

in m, Gmi, MB, Una, mi. 

In this paper, we focus on potential games 111261 . which form a class of strategic form games 
with the following desirable properties: 
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TABLE I: Games discussed in this paper. 


Section 

System model 

Strategy 

Payoff 

El 

Fig. Hu] 

Channel 

Interference power 

Eii 

Fig.Hg 

Channel 

SINR or Shannon capacity 

lyiil 

Fig. Hu] 

Channel 

Number of interference signals 

Eml 

Figs. HU] and Utd)! 

Channel 

Interference power 

HU 

Figs. lJlIc)| and UHd)! 

Channel 

SINR or Shannon capacity 

m 

Fig.Hm 

Channel 

Number of interference signals 

im 

Fig. HI 

Channel 

Successful access probability or throughput 

HI 

Fig. HI 

Transmission probability 

Successful access probability or throughput 

pain 

Fig. HI 

Transmission power 

Throughput or Shannon capacity 

Povl 

Fig. HI 

Transmission power 

Connectivity 

Hvj 

Fluid network 

Amount of traffic 

Congestion cost 

Hvll 

M/M/1 queue 

Arrival rate 

Trade-off between throughput and delay 

PfWl 

Mobile sensors 

Location 

Connectivity or coverage 

IXVIIII 

Immobile sensors 

Channel 

Coverage 


• The existence of a Nash equilibrium in potential games is guaranteed in many practical 
situations [I126H (Theorems [U and [2] in this paper), but is not guaranteed for general strategic 
form games. Other classes of games possessing Nash equilibria are summarized in W2[ §2.2] 
and UMl §3.4]. 

• Unilateral improvement dynamics in potential games with finite strategy sets are guaranteed 
to converge to the Nash equilibrium in a finite number of steps, i.e., they do not cycle II126II 
(Theorem m in this paper). As a result, learning algorithms can be systematically designed. 

A game that does not have these properties is discussed in Example [2] in Section |nl 

We provide an overview of problems in wireless networks that can be formulated in terms 
of potential games. We also clarify the relations among games, and provide simpler proofs of 
some known results. Problem-specific learning algorithms Il92l . [|168ll are beyond the scope of 
this paper. 

The remainder of this paper is organized as follows: In Sections HU Hill and H3 we introduce 
strategic form games, potential games, and learning algorithms, respectively. We then discuss 
various potential games in Sections |V] to IXVTTTl as shown in Table HI Einally, we provide a few 
concluding remarks in Section IXIXl 
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(a) Multiple-access (b) TX-RX pairs (c) TXs (Gij = Gji). (d) Canonical network model (e) Interference graph, 
channel. {Gij ^ Gji^. {Gij = Gji^. 


Fig. 1: System models. Straight blue lines represent communication channels of player i and red 
dashed lines represent interference channels to player i. 


The notation used here is shown in Table im Unless the context indicates otherwise, sets 
of strategies are denoted by calligraphic uppercase letters, e.g., Ai, strategies are denoted by 
lowercase letters, e.g., ai e Ai, and tuples of strategies are denoted by boldface lowercase 
letters, e.g., a. Note that ai is a scalar variable when Ai is a set of scalars or indices, ai is a 
vector variable when Ai is a set of vectors, and ai is a set variable when Ai is a collection of 
sets. 

We use M to denote the set of real numbers, M+ to denote the set of nonnegative real numbers, 
M++ to denote the set of positive real numbers, and C to denote the set of complex numbers. The 
cardinality of set A is denoted by |^|. The power set of A is denoted by 2-^. Finally, 1 condition 
is the indicator function, which is one when condition is true and is zero otherwise. 

We treat many system models, as shown in Fig. [U In multiple-access channels, as shown in 


Fig. [l|{a)|, multiple transmitters (TXs/users/mobile stations/terminals) transmit signals to a single 


receiver (RX/base station (BS)/access point (AP)). In Fig. illta)[ G* represents the link gain from 
TX i to the RX. 

In a network model consisting of TX-RX pairs, as shown in Fig. [l |{b)[ each TX i transmits 
signals to RX i. In this case, Gij ^ Gji. In a network model consisting of TXs shown in 


Fig.ll|{c)i each TX (BS/AP/transceiver/station/terminal/node) interferes with others. In this model, 
Gij = Gji. A “canonical network model” m, shown in Fig. [l |)^d)| , consists of clusters that are 
spatially separated in order for Gij = Gji to hold. Note that these network models have been 
discussed in terms of graph structure in [114311 . 
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We use ji to denote a direeted link from TX i to TX j or eluster i to eluster j. Let interferenee 
graph (X, be an undireeted graph, where the set of vertiees X = {1,2,... } eorresponds to TXs 
or elusters, and i interferes with j if ji e 8, as shown in Fig. [l |{e)[ i.e., 8 := { ji \ GjiP > T } 
where P is the transmission power level for every TX and T is a threshold of the reeeived 
power. Note that in undireeted graph {1,8), ji e 8 ij G 8, for every {i,j} C X. We 

denote the neighborhood of i in graph (1,8) by Xj := {j G X \ {i} \ ji ^8}. We also define 

Xj (c) .= { J G Xj I Cj = Cj}, then, |Xj (c)| = lcj=ci ~ lcj=ci lijef- 

II. Game-theoretic Framework 

We begin with the definition of a strategie form game and present an example of a game- 
theoretie formulation of a simple ehannel seleetion problem. Moreover, we diseuss other useful 
eoneepts, sueh as the best response and Nash equilibrium. The analysis of Nash equilibria in the 
ehannel seleetion example reveals the potential presenee of eyeles in best-response adjustments. 

Definition 1: A strategic (or normal) form game is a triplet Q := (X, {Ai)i^x, {ufii^i), or simply 
Q := (X, (Ai), (ui)), where X = {1, 2,..., |X|} is a finite set of players (deeision makers j], Ai 
is the set of strategies (or aetions) for player i G X, and Ui: Y\.i&x A —>■ R is the payoff (or 
utility) funetion of player i G X that must be maximized. 

If iS C X, we denote the Cartesian produet If *5 = X, we simply write A to 

denote Ax, and to denote When S = I \ {i}, we let A-i denote Ax\{i}, and 

denote Y.j(xx\{i}- ^ = {ai)ies e ^ 5 , a = (a*, a_i) = (oi,..., a|i|) G A, and 

d—i (^ 1 ? • • • 7 ^i—l, • • • : ^|X|) ^ A—i- 

Example 1: 

Consider a ehannel seleetion problem in the TX-RX pair model shown in Fig. [l Kb)[ Eaeh 
TX-RX pair is assumed to seleet its ehannel in a deeentralized manner in order to minimize the 
reeeived interferenee power. 

The ehannel seleetion problem ean be formulated as a strategie form game Q\'.= (X, (C,), (uE)). 
The elements of the game are as follows: the set of players X is the set of TX-RX pairs. The 
strategy set for eaeh pair i, Ci is the set of available ehannels. The reeeived interferenee power 


'infinite player (or non-atomic) potential games introduced in 11501 . 11511 are beyond the scope of this paper. Infinite player 
potential games have been applied to BS selection games 11581 . Gto). 
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TABLE II: Notation. 


g 

Strategic form game 

I 

Finite set of players, I — {1, 2,..., \T\} 

If {a) 

:= { i e X / € tti } 

A, 

Set of strategies for player i € X 

A 

Strategy space, fligi H 

Ui 

Payoff function for player i € X 

<!> 

Potential function 

BRi 

Best-response correspondence of player i 

ai 

Strategy of player i, ai € Ai 

A(A) 

Set of probability distributions over Ai 

Xi 

Mixed strategy, Xi € A(^i) 

X 

Mixed strategy profile, x £ Hi A(^i) 

Gi 

Link gain between TX i and a single isolated RX in Fig. [lHa)| 

Gij 

Link gain between TX j and RX i; Gji ^ Gij in Fig. [jHb)| and Gji = Gij in Figs. [jllc)| and [jlld)| 

A 

Directed link from i to j 

s 

Set of edges in undirected graph 

X 

:= { J G X \ {i} \ ji G £ }. Neighborhood in graph (X, £) 


■■= {j gX 1 cj = a}. 

N 

Common noise power for every player 

Ni 

Noise power at RX i 

Niia) 

Noise power at RX i in channel a 

He) 

Interference power at RX i at channel arrangement c 

Ci 

Set of available channels for player i 

Ci Ci) 

Channel of player i 

c 

■■= (Ci)iei e YliCi 

Vi 

Set of available transmission power levels for player i 

Pi (e Vi) 

Transmission power level of player i as a strategy 

p 

:= (Pi)i6i € Hi Ti 

P 

Identical transmission power level for every player 

Pi 

Transmission power level for player i as a constant 

r 

Required signal-to-interference-plus-noise power ratio (SINR) 


at RX z G X is determined by a eombination of ehannels c = (Q)jgi G C = Y\iCi, where 

Ii{c) ( 1 ) 
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Let —Ii{c) be the payoff function to be maximized, i.e., 


i^{c) := -Ii{c) = - ^ GijP ■ ( 2 ) 

Note that ^was introduced in [|140ll . and we further discuss it in Example [2l 

Definition 2: The best-response correspondency (or simply, best response) BRj: A-i —)■ 2-^* 
of player i to strategy profile a_i is the correspondence 


BRi(a_i) 

:= {ttiE Ai\ Ui{ai,a_i) > a_i), Va- e Ai}, (3) 

or equivalently, BRi(a_j) := argmaXa^sA «■-*)• 

A fundamental solution concept for strategic form games is the Nash equilibrium: 

Definition 3: A strategy profile a* = G ^ is a pure-strategy Nash equilibrium (or 

simply a Nash equilibrium) of game (X, {Afi, (m*)) if 

Ui{a*, a*_i) > ufitti, ( 4 ) 

for every i G X and a, G A^; equivalently, a* G BRj(alJ for every i G X. That is, a* is a 
solution to the optimization problem maxa.g_ 4 . ufioi, 

At the Nash equilibrium, no player can improve his/her payoff by adopting a different strategy 
unilaterally, thus, no player has an incentive to unilaterally deviate from the equilibrium. The 
Nash equilibrium is a proper solution concept; however, the existence of a pure-strategy Nash 
equilibrium is not necessarily guaranteed, as shown in the next example. 

Example 2: Consider ^ and the arrangement shown in Fig. O i.e., X = {1, 2, 3}, C* = {1, 2} 
for every i, and Gi^ > G 12 , G 21 > G 23 , and G 32 > The game does not have a Nash 

equilibrium, i.e., for every channel allocation, at least one pair has an incentive to change his/her 
channel. The details are as follows: when all players choose the same channel, e.g., (ci, C 2 , C 3 ) = 
(1,1,1), every player has an incentive to change his/her channel because BRj(c_j) = {2} for 
all /; thus, it is not in Nash equilibrium. On the contrary, when two players choose the same 
channel, and the third player chooses a different channel, e.g., ( 01 , 02 , 03 ) = (1,1,2), as shown 


correspondence is a set-valued function for which all image sets are non-empty, e.g, 1921 . GUI. 
^This setting is essentially the same as that used in 1631 . fml . GTtI Example 4.17], G34l . 
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Fig. 2: Arrangement used in Example [2l A eyele results from the best-response adjustment. 


in Fig. [2a), BR 2 (c_ 2 ) = {2}, i.e., pair 2 has an incentive to change its channel 02 from 1 to 
2, and dH) does not hold. Because of the symmetry property of the arrangement in Fig. [2l every 
strategy profile does not satisfy Q. Furthermore, the best-response channel adjustments, which 
will be formally discussed in Section jlVl cycle as (1,1, 2), (1, 2, 2), (1, 2,1), (2, 2,1), (2,1,1), 
(2,1, 2), and (1,1, 2), as shown in Figs. |2ta-f). 

The channel allocation game ^ is discussed further in Section jVj 

III. Potential Games 

We state key definitions and properties of potential games in Section ITTT-Al show how to 
identify and design exact potential games in Sections ITTT-BI and ITTT-Cl and show how to identify 
ordinal potential games in Section IIII-Dl 
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A. Definitions and Properties of Potential Games 

Monderer and Shapley II126II introduced the following elasses of potential garnet : 

Definition 4: A strategie form game (X, (Ai), («*)) is an exact potential game (EPG) if there 
exists an exact potential function 0: ^ R sueh that 


■Uj(cij, ri_j) ri_j) 


(5) 


for every i G X, a*, a' & Ai, and a_i G A-i. 

Definition 5: A strategie form game (X, (.4,*), («*)) is a weighted potential game (WPG) if 
there exist a weighted potential function 0: 4, —R and a set of positive numbers sueh 

that 


ufoi, a_i) - ufia'i, a_i) = Q;i(0(ai, a_i) - 0(a-, a_i)), (6) 

for every i ai,a[ & Ai, and a_j G A-i. 

Definition 6: A strategie form game (X, {Afi, (m*)) is an ordinal potential game (OPG) if there 
exists an ordinal potential function 0: 4. —)■ R sueh that 


sgn(Mi(ai, a_i) - ufa^, a_i)) 

= sgn{(j){ai,a-i) - (j){a[,a-i)), (7) 

for every i G X, Oj, a' G Ai, and a-i G A-i, where sgn(-) denotes the sign funetion. 

Although the potential funetion 0 is independent of the indiees of the players, 0 refleets any 
unilateral ehange in any payoff funetion Ui for every player i. 

Sinee an EPG is a WPG and a WPG is an OPG [I126H . II177II . the following properties of 
OPGs are satisfied by EPGs and WPGs. 

Theorem 1 (Existence infinite OPGs): Every OPG with finite strategy sets possesses at least 
one Nash equilibrium II126[ Corollary 2.2]. 

Theorem 2 (Existence in infinite OPGs): In the ease of infinite strategy sets, every OPG with 
eompaet strategy sets and eontinuous payoff funetions possesses at least one Nash equilibrium 
II126[ Eemma 4.3]. 


"'There are a variety of generalized concepts of potential games, e.g., generalized ordinal potential games UM, best-response 
potential games (mi, pseudo-potential games El, near-potential games 1281 . 1291 . and state-based potential games (TTal . 
Applications of these games are beyond the scope of this paper. 
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Theorem 3 (Uniqueness): Every OPG with a compact and convex strategy space, and a strictly 
concave and continuously differentiable potential function possesses a unique Nash equilibrium 
[11381 Theorem 2], II154II . 

The most important property of potential games is acyclicity, which is also referred to as the 
finite improvement property. 

Definition 7 (Finite improvement property l\126\l ): A path in (X, (Ai), (ui)) is a sequence 
(a[0], a[l],...) such that for every integer k > 1, there exists a unique player i such that 
afik] 7 ^ ai[k — l] G Ai while = a_j[fc — 1 ]. (a[0],a[l],...) is an improvement path if, for 

every k > 1, ufiafi]) > Ui{a[k—1]), where i is the unique deviator at step k. (X, (Ai), (ui)) has 
the finite improvement property (FIP) if every improvement path is finite. 

Theorem 4: Every OPG with finite strategy sets has the PIP 111261 Eemma 2.3]; that is, unilateral 
improvement dynamics are guaranteed to converge to a Nash equilibrium in a finite number of 
steps. 


B. Identification of Exact Potential Games 

The definition of an EPG utilizes a potential function ([5]). Sometimes, however, it is beneficial 
to know if a given game is an EPG independently of its potential function. The following 
properties of EPGs and classes of games known to be EPGs are useful for the identification 
and derivation of potential functions. Note that each EPG has a unique exact potential function 
except for an additive constant 111261 Eemma 2.7]. 

Theorem 5: Eet (X, (Ai), (ui)) be a strategic form game where strategy sets Ai are intervals 
of real numbers and payoff functions Ui are twice continuously differentiable. Then, the game 
is an EPG if and only if 

d^Uija) ^ d\{a) 

dtti dttj dtti dttj ’ 

for every i,j e X 111261 Theorem 4.5]. 

Theorem 6 : Eet (X, (Ai), and (X, (Ai), (Mi, 2 )) be EPGs with potential functions 

and 4>2{o), respectively. Purthermore, let a, e M. Then, (X, (Ai), (aui^i + l3ui^2)) is an EPG 
with potential function a0i(a) + / 902 («) [l59ll . 
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1) Coordination-dummy Games: If Ui{a) = u{a) for all i G X, where u: A the game 

(X, (^j), (m)) is ealled a coordination gamcl or an identical interest game, and u is ealled a 
eoordination funetion [|59ll . 

If Ui{a) = di{a_i) for all i G X, where di\ A-i —)■ M, the game (X, (Ai), (dj)) is ealled a 
dummy game, and di is ealled a dummy funetion ll59l . 

If Ui{a) = Si{ai) for all z G X, where Si: Ai —)■ M, the game {I, (Ai), (si)) is ealled a 
self-motivated game, and s, is ealled a self-motivated funetion II133II . 

Theorem 7: (X, (Ai), (ui)) is an EPG if and only if there exist funetions u: A ^ M. and 
di : A-i —)■ M sueh that 


uftti, a-i) = u{ai, a-i) + dfa-i), (9) 

for every z G X [[59ll , ni63L This game is said to be a coordination-dummy game. The potential 
funetion of this game is (j){a) = u{a). 

Example 3: From Theorem |71 any identieal interest game is an EPG. Almost all games found 
in studies applying identieal interest games [fT9l . (271, (55l . (74l . (1071 . (1421 . (1651 have the 
form of game Q2 := (X, {Ai), {tM)), where 

M{a) ■=Y^fj{a), ( 10 ) 

j 

for every z G X and fj{a) is a performanee indieator of player j, e.g., fj{a) is the individual 
throughput and i^{a) is the aggregated throughput of all players (1651 . Note that in most of 
these works, ^ is used for eomparison with other games. 

Example 4: Closely related to ^21 the form of game ^3 with payoff 

^(a) := fi{ai,axf) + (11) 

jC:Ii 

where f: Ai x Ax^ M, is found in many seenarios: data stream eontrol in multiple-input and 
multiple-output (MIMO) (T4l . ehannel assignment (1881 . joint power, ehannel and BS assignment 
(1621 . joint power and user seheduling (2061 . BS seleetion (54l . and BS sleeping 12081 . Note 
that ^is not an identieal interest game, but ean be seen as ^on graphs, where the performanee 
indieator of player z is a funetion of strategies of its neighbors, i.e., f: Ai x Axi K, and the 


^The term “coordination game” is also used to describe games where players receive benefits when they choose the same 


strategy Ezl. 
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sum of the performance indicators of player i and neighbors Xj is set for the payoff function of 
player i. It can be easily proved that ^ is an EPG with potential 

= X] aXi). (12) 

i 

2) Bilateral Symmetric Interaction Games: A strategic form game QA := (X, (.4,*), (t®)) is 
called a bilateral symmetric interaction (BSI) game if there exist functions Wij: Ai x 4.^ —)■ M 
and Sj: —)■ M such that 


?®(a) = - Si{ai), 

where Wij{ai,aj) = Wji{aj,ai) for every {ai,aj) e Ai x Aj II174L 

Theorem 8 ( l[174\l ): A BSI game ^is an EPG with potential functior^ 


(13) 


(^a) = ^^^Wij(ai,aj) - ^Si(ai) 
i i 

= '^Wij{ai,aj)-'^Si{ai). (14) 

i<j i 

Example 5: Consider a quasi-Cournot game Q5 := (X, (4.*), (43)) with a linear inverse 
demand function, where each player i G X produces a homogeneous product and determines the 
output. Eet Ai = M++ be a set of possible outputs. The payoff function of player i is defined 
by 


?jl3(a) := [a- P “ costi(aj), 


(15) 


where a, 13 > 0 and costj: 4.* —)■ M is a differentiable cost function. Since 


ijl3(a) = aoi - - cosE(aj) - (3 


self-motivated function 


BSI 


(16) 


^ is an EPG with potential 


43(a) = a^^tti- 13 ^^ - Y,i G(ai) - 4 (12) 

[I163II . Eurther discussion can be found in II126L II174L 


fi'ip _ ■'p _ Y^|i| 'p|i| 

Z-/Z—1 i + 1 ■ 
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3) Interaction Potential: 

Theorem 9 ( hl74\l ): A normal form game QQ := (X, (.4,*), (t©)) is an EPG if and only if 
there exists a function {T>s \ <T>s\ As —)■ M, 5 C X } (called an interaction potential) such that 

iMia) = ^<Psias), (18) 

sci-.ies 

for every a E A and i EX. The potential function is 

(19) 

SCI 

4) Congestion Games: In congestion games (CGs), the payoff for using a resource (e.g., a 
channel or a facility) is a function of the number of players using the same resource. More 
precisely, CGs are defined as follows: 

In the congestion model proposed by Rosenthal H 14911 . each player i uses a subset Oj of common 
resources X”, and receives resource-specific payoff w/(|X-^ (a) |) from resource f E at according to 
the number of players using resource /. Here, wj: {1, ..., |X|} —)■ M, X-f (a) := { i e X | / e } 
represents the set of players that use resource /. Then, |X'f^(a)| = l/ea^- 

A strategic form game Q7 := (X, (4.*), (43)) associated with a congestion model, where 
Ai C 2 ^ and 

^(«) := (20) 

fCai 

is called a CG. Note that Ai is a collection of subsets of X and is not a set. Moreover, a* G Ai 
is a set, not a scalar quantity. Note that a CG where the strategy of every player is a singleton, 
i.e., A C X and i^{ci) = Wai{\X°‘*{a)\) is called a singleton CG. 

Theorem 10: A CG ^is an EPG with potential function 

/X(a)| \ 

Ma) = ^/(^) ) ( 21 ) 

/GUitti y k=l J 

ni26[ Theorem 3.1] 11491 . Eurthermore, every EPG with finite strategy sets has an equivalent 
CG Em Theorem 3.2]. 

Note that generalized CGs do not necessarily possess potential functions. Eor generalized CGs 
with potential, we refer the interested reader to El, II120II . It was proved that CGs with player- 
specific payoff functions II125II . and those with resource-specific payoff functions and player- 
specific constants 1112011 . have potential. CGs with linear payoff function on undirected/directed 
graphs has been discussed in EOl . 
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C. Design of Payojf Functions 

In some scenarios, we can design payoff functions and assign them to players to ensure that 
the game is an EPG. Such approach is often applied in the context of cooperative control UllSL 
These design methodologies can be used when we want to derive payoff functions from a given 
global objective so that the game with the designed payoff functions is an EPG with the global 
objective as the potential function. If the global objective is in the form of (fT9l) . we can derive 
payoff functions by using (fTSl) . 

Otherwise, we can utilize many design rules: the equally shared rule, marginal contribution, 
and the Shapley values II159II . II1741I . Since Marden and Wierman [111811 have already summarized 
these rules, we only present marginal contribution here. 

Marginal contribution, or the wonderful life utility (WLU) [I182II . is the following payoff 
function derived from the potential function: 

Ui{a) = (j){a) - (22) 


where is the value of the potential function in the absence of player i. The game with 

the WEU is an EPG with potential function f [I118L 

When the potential function for each player is represented as the sum of functions ^ R, 
i.e., 0(a) = fj{o) and 4>{a_i) = the WEU (l22l) can be written as 

Ui{a) = Ej fjH - /i(a-i) 

= /i(«) - 'EjjLiifjia-i) - fj{a)), (23) 


where fj{a_i) — fj{a) represents the loss to player j resulting from player Fs participation. 

Example 6 (Consensus game): In the consensus problem II173II . each player i adjusts a* and 
tries to reach ai = 02 = ■■■ = a\x\- 

Marden et al. II115II considered the global objective 

08Ka) :=- Ojll, (24) 

i j £li 

and proposed using the WEU 

t@(a) := _^||a. _ afl = ^||ai - afl lij^e ■ (25) 

j&Ii j^i 

Since game G8 := (X, (A), (r®)) is a BSI game with Wij{ai,af) = —\\ai — aj\\ ^ is 

confirmed to be an EPG. 


June 29, 2015 


DRAFT 


















12 


D. Identification of Ordinal Potential Games 

In contrast to EPGs, OPGs have many ordinal potential funetions II126L 
Theorem 11: Consider the game (X, (Ai), {ui}). If there exists a strietly inereasing transfor¬ 
mation /*: M ^ M for every i G X sueh that game (X, (A), ifiiui))) is an OPG, the original 
game (X, (.4,*), («*)) is an OPG with the same potential funetion II133II . 


IV. Learning Algorithms 


A variety of learning algorithms are available to faeilitate the eonvergenee of potential games to 
Nash equilibrium, e.g., myopie best response, fietitious play, reinforeement learning, and spatial 
adaptive play. Unfortunately, there are no general dynamies that are guaranteed to eonverge 
to a Nash equilibrium for a wide elass of games irTTll . Sinee Lasaulee et al. [|9^ Seetions 5 
and 6] eomprehensively summarized these learning algorithms and their suffieient eonditions 
for eonvergenee for various elasses of games (ineluding potential games), we present only two 
frequently used algorithms. 

Definition 8: Best-response dynamics refers to the following update rule: At eaeh step k, 
player z G X unilaterally ehanges his/her strategy from afik] to his/her best response a_i[k\, in 
partieular. 


afk + 1] G BRj(a_j[/c]). 


(26) 


The other players ehoose the same strategy, i.e., a^fik + 1] = CL-i[k]. 

Note that while the term “best-response dynamies” was introdueed by Matsui [I119II . it has 
many representations depending on the type of game. We also note that best-response dynamies 
may eonverge to sub-optimal Nash equilibria. By eontrast, the following spatial adaptive play 
ean eonverge to the optimal Nash equilibrium. To be preeise, it maximizes the potential funetion 
with arbitrarily high probability. 

Definition 9: Consider a game with a finite number of strategy sets. Log-linear learning [l22l . 
spatial adaptive play [11981 . and logit-response dynamics [El refer to the following update rule: At 
eaeh step k, a player z G X unilaterally ehanges his/her strategy from afik] to a* with probability 
Xi G A(4.i) aeeording to the Boltzmann-Gibbs distribution 



(27) 
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where /3 (0 < /? < cxo) is related to the (inverse) temperature in an analogy to statistical physics. 
Note that in the limit —)■ oo, the spatial adaptive play approaches the best-response dynamics. 

Note that (1271) is the solution to the following approximated maximization problem: 


max a_j) = max E 

ateAi Xi(ai) 


^ max 

Xi(ai) 


^ ^ Xj(cij) Oj—i) 

.Q-i ^A-i 


Xi{ai)\ogXi{ai) , 

di^Ai 


(28) 


which is called a perturbed payoff, where J2ai€Ai log 2 ;i(ai) is the entropy function. The 
derivation of (1271) from (l28l) can be found in IfTTlI . 


Theorem 12 ( l[22\l . I \198\l }: In the finite EPG (X, {Ai), {ui)) with potential function 0, the 
spatial adaptive play has the unique stationary distribution of strategy profile x G A(^), where 

exp [/30(a)] 


X a = 


Eae.4 exp [/30(a)]’ 


(29) 


i.e., it is also the Boltzmann-Gibbs distribution. 
Further discussion can be found in IfTSlI . II117II . 


V. Channel Assignment to Manage Received and Generated Interference 

Power in TX-RX Pair Model 


In the TX-RX pair model shown in Fig. [l Kb)| , Nie and Comaniciu H 14011 pointed out that 
the channel selection game ^ introduced in Section |n] was not an FPG. Note that the payoff 
function of ^is the negated sum of received interference from neighboring TXs. To ensure that 
the channel selection game is an FPG, they considered the channel selection game Q9, whose 
payoff function was the negated sum of the received interference from neighboring TXs, and 
generated interference to neighboring RXs, i.e.. 


?i9l(c) -f GjiPi) lcj=ci ■ (30) 

j¥=i 

Since ^is a BSI game with Wij{ci, Cj) = —{GijPj + GjiPi) lcj=ci, h is an EPG with potential 

flc) = - ^ /.(c) = - 1 .,..,, ( 31 ) 

i i j^i 

which corresponds to the negated sum of received interference in the entire network. Note that 
in order to evaluate (1^ . each pair i needs to estimate or share the values of the generated 
interference to neighboring RXs, GjiPi lcj=ci- 
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Concurrently with the above, Kaulfmann et al. If82l diseussed the following potential funetion 
010(c), whieh ineludes RX-speeifie noise power Xj(cj), and derived a payoff funetion using 
Theorem |9l 


4in](c) - - GijPj 

(32) 

i j^i i 


^IHKc) = — "^^{GijPj + GjiPi) tcj=Ci —Ni{Ci)- 

(33) 


To enable multi-ehannel alloeation, e.g., orthogonal frequency-division multiple aeeess (OFDMA) 
subearrier alloeation or resouree bloek alloeation. La et al. [[88ll diseussed a modifieation of 
suitable for multi-ehannel alloeation. 

In eontrast to unidireetional links assumed in the TX-RX pair model, Uykan and Jantti 
il75L [I176II diseussed a ehannel assignment problem for bidireetional links and proposed a 
joint transmission order and ehannel assignment algorithm. 

A. Joint Transmission Power and Channel Allocation 

Nie et al. II141II showed that the joint ehannel seleetion and power eontrol game with payoff 
funetion 

dl(p, c) := - + GjiPi) lc,=c,. (34) 

is an EPG. Beeause the best response in ^11 results in the minimum transmission power level, 
Bloem et al. IITTI proposed adding terms alog(l -f GaPi) -f j3/pi to (l34l) to aeeount for the 
aehievable data rate and eonsumed power. Note that these terms are self-motivated funetions, 
and the game with the modified payoff funetion is still an EPG. 

As another type of joint assignment, a preliminary beamform pattern setting followed by 
ehannel alloeation was diseussed in II203II . 

B. Primary-secondary Scenario and Heterogeneous Networks 

To manage interferenee in primary-seeondary systems, Bloem et al. ll2TI proposed adding 
terms related to the reeeived and generated interferenees from and to the primary user. They 
also proposed adding eost terms related to payoff funetion (l34l) . In partieular, they diseussed a 
Staekelberg game II131L where the primary user was the leader and the seeondary users were 
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followers. Giupponi and Ibars discussed overlay cognitive networks [[6^ and heterogeneous 
OFDMA networks lf67l . Mustika et al. [I129II took a similar approach to prioritize users. 

Uplinks of heterogeneous OFDMA cellular systems with femtocells were discussed in [I130H . 
whereas downlinks of OFDMA cellular systems, where each BS transmits to several mobile 
stations, were discussed in [[89ll . [l90ll . OFDMA relay networks were considered in [l96ll . Further 
discussion can be found in [17^ . Joint BS/AP selection and channel selection problems were 
discussed in [|48l . 


VI. Channel Assignment to Enhance SINK and Throughput in TX-RX Pair 

Model 

In the TX-RX pair model shown in Fig. [l |[b)[ the signal-to-interference-plus-noise ratio (SINR) 
at RX i is given by 

GiiPi GiiPi 


=: SINRi(c). 


(35) 


Ni + /i(c) Ni + GijPj lcj=ci 

Menon et al. [I122II pointed out that there may be no Nash equilibrium in the channel selection 
game (X, (C,), (SINK,)). 

Instead, they proposed using the sum of the inverse SINR, defined by 

1 


4121(c) := 


^ G„P, 


SINR,(c) ^ G„P, 


1 Ct — Ci 5 


(36) 


as the payoff function. Similar to ^ ^12 := (X, (Cj), (4121)) is a BSI game with Wij{ci, Cj) = 
-[{GijPj/GiiPi) + {GjiPi/GjjPj)] lcj=ci- Thus, ^I2]is an EPG with potential 

1 


<mo) = -Y. 


SINRXc)’ 


(37) 


i.e., the sum of the inverse SINR in the network. 

Note that the above expression is a single carrier version of orthogonal channel selection. 
Menon et al. HI2211 discussed a waveform adaptation version of G12I that can be applied to 
codeword selection in non-orthogonal code division multiple access (CDMA), and Buzzi et 
al. Il2^ further discussed waveform adaptation. Buzzi et al. [l23l also discussed an OFDMA 
subcarrier allocation version of G12[ Cai et al. [l25ll discussed joint transmission power and 
channel assignment utilizing the payoff function (l3^ of G121 
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Gallego et al. 1(631 proposed using the network throughput of joint power and ehannel assign¬ 
ment, 

lsiNRi(p,c)>r Bc^ log (1 -I- SINRj(p, c)), (38) 

i 

as potential, where Bc^ is the bandwidth of ehannel q, and B is the required SINK. It may have 
been diffieult to derive a simple payoff funetion, and they thus proposed the WLU (l23l) of (l38l) . 

VII. Channel Assignment to Manage the Number of Interference Signals in 

TX-RX Pair Model 

Yu et al. 111991 and Chen et al. [|3^ eonsidered sensor networks where eaeh RX (sink) reeeives 
messages from multiple TXs (sensors). They proved that a ehannel seleetion that minimizes the 
number of reeeived and generated interferenee signals is an EPC, where the potential is the 
number of total interferenee signals. Note that the average number of retries is approximately 
proportional to the number of reeeived interferenee signals when the probability that the messages 
are transmitted is very small, as in sensor networks. 

A simpler and related form of (l30l) is detailed in the following diseussion. To reduee the 
information exehange required to evaluate (l30l) . Yamamoto et al. 111951 proposed using the 
number of reeeived and generated interferenee sourees as the payoff funetion, where the reeeived 
interferenee power is greater than a given threshold T, i.e., 

lil3l(c) ^ {lGijPj>T + lGjiPi>T) lcj=Ci ■ (39) 

This model is sometimes referred to as a “binary” interferenee model 11101 in eomparison 
with a “physieal” interferenee model. Beeause ^13 := iX. (C,). (rJT3l)) is a BSI game with 
Wij{ci, Cj) = -{lGijPj>T + lGjiPi>T) lcj=ci, ^I3]is an EPC. When we eonsider a direeted graph, 
where edges between TX j and RX i indieate GijPj > T, we denote TX Ts neighboring RXs 
by TZi ■.= {j e X \ j ^ i and ji ^ £}, and RX i’s neighboring TXs by 71 := { j G X | j 7 ^ 
i and ij e £}. Using these expressions, (l39l) ean be rewritten to 

~ ^ ^ (1ug£ T Ijigf) l.cj=Ci 

= “ ^ lc^=ci ~ ^ lcj=Ci • (40) 

jeTi jeHi 

Yang et al. 11961 diseussed a multi-ehannel version of 
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VIII. Channel Assignment to Manage Received Interference Power in TX 

Network Model 


A. Identical Transmission Power Levels 


In Section |Vl channel allocation games in the TX-RX pair model shown in Fig. [l|{b) 


are 


discussed. Neel et al. ni35L [I136H considered a different channel allocation game typically 
applied to channel allocation for APs in the wireless local area networks (WLANs) shown in 


Fig. [l |{c)[ where each TX i G X selects a channel Cj G Cj to minimize the interference from other 
TXs, i.e., 


d(c) := -h{c) := 

j¥=i 


(41) 


where P is the common transmission power level for every TX. Note that Gij = Gji in this 
scenario, whereas Gij ^ Gji in the TX-RX pair model shown in Fig. [l |{b)[ Moreover, note that 
interference from stations other than the TXs is not taken into account in the payoff function. 
In addition to the TX network model, channel selection can be applied to the canonical network 
model shown in Fig. [l |{d)| ifTSlI . 

Because ^14 is a BSI game where Wij{ci, Cj) = —GijP lci=cj, it is an EPG with potential 


4IlKc) = 


(42) 


which corresponds to the aggregated interference power among TXs. Neel et al. pointed out that 
other symmetric interference functions, e.g., max{i? — |cj — Cj\, 0}/P, where B is the common 
bandwidth for every channel, can be used instead of lci=cj in (SU). 

Kauffmann et al. [|^ discussed essentially the same problem. However, they considered 
player-specific noise, and derived (l4TI) by substituting Gij = Gji and Pi = Pj = P into (l33l) . 

Compared with the payoff function (l30l) . (|4TI) can be evaluated with only local information 
available at each TX; however, the transmission power levels of all TXs need to be identical. 
We further discuss this requirement in Section IVIII-Bl 

Liu and Wu [I105H reformulated the game represented by (|4TI) as a CG by introducing virtual 
resources. Further discussion can be found in lf93l . 
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B. Non-identical Transmission Power Levels 

To avoid the requirement of identieal transmission power levels in (ITO . Neel HI3411 proposed 
using the produet of (eonstant) transmission power level P* and interferenee /i(c) as the payoff 
funetion, i.e., 

ti[l5l(c) := -Pili{c) = -Pi ^ GijPj lci=ci ■ (43) 

Beeause ^15 is a BSI game with Wij = —PiGijPj lcj=ci, <^151 is an EPG with 

(^SLc) = GijPj lcj=ci . (44) 

i 

Note that this form of payoff funetions was provided by Menon et al. I1123II in the eontext of 
waveform adaptations. This game under frequeney-seleetive ehannels was diseussed by Wu et 

al. msi. 

The relationship between (l43l) and its exaet potential funetion (l44l) implies that the game ^16 
with payoff funetion 

ij[l6l(c) := -hie) = - ^ GijPj lc^=ci (45) 

is a WPG with potential funetion d lTCT c) and a* = 1/Pj in i.e., the identieal transmission 
power level required in (l4T]) is not neeessarily required for the game to have the FTP This was 
made elear by Bahramian et al. ifTTl and Babadi et al. ifTSll . 

As extensions, in [I179II . the interferenee management game ^17 on graph struetures with the 
following payoff funetion was diseussed: 

?j[I7l(c) := -Pi ^ GijPj 

i£Xi 

= -Pi GijPj lc,=ci Iji^s ■ (46) 

i 

[11851 . 1121011 proposed using the expeeted value of interferenee in order to manage fluetuating 
interferenee. Zheng [l207ll treated dynamieal on-off aeeording to traffle variations in G16[ 

IX. Channel Assignment to Enhance SINK and Capacity in TX Network Model 

Menon et al. II123II showed that a waveform adaptation game where the payoff funetion is 
the SINK or the mean-squared error at the RX is an OPG. Chen and Huang [l40l showed that a 
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channel allocation game in the TX network model shown in Fig.[lKc)[ or in the canonical network 
model shown in Fig. [l |{d)| , where the payoff function is the SINK or a Shannon capacity, is an 
OPG. Here, we provide a derivation in the form of channel allocation according to the derivation 
provided in [I123L A channel selection game ^18 with payoff function 

?j[I3(c) := -Pi[Ni{ci) + Ii{c)] (47) 

is an EPG with potential 


1 


(file) = - P,iV,(c,) - - PMc 


Because Pi is a constant in (1471) . by Theorem [TTl Q19 with payoff 

GiiP 


fi9l(c) := 


(48) 


(49) 


fiKc) Ni{ci) + Ii{c) 

is an OPG with potential (file). As a result, once again using Theorem [TTl ^20 with payoff 


fini(c) := B log (1 + tJT^fc)) 

GiiPi 


= P log 1 + 


(50) 


Ni{ci) + Ii{c) 

is an OPG with potential (file). Xu et al. [I191II further discuss G201 where the active TX set 
can be stochastically changed. 

A quite relevant discussion was conducted by Song et al. [11651 . They discussed a joint 
transmission power and channel assignment game ^21 to maximize throughput: 

m{p,c):=R(l+ 


Ni{ci) + Ii{p,c) ‘ 

where P : M —)■ M represents throughput depending on SINK. They pointed out that since each 
user would set the maximum transmission power at a Nash equilibrium, G21I is equivalent to 
the channel selection game 0141 Further discussion on joint transmission power and channel 
assignment can be found in 1110911 . 


X. Channel Assignment to Manage the Number of Interference Signals in 

Interference Graph 

For the interference graph (X, £) shown in Fig. He) [ Xu et al. fllSSll proposed using the number 
of neighbors that select the same channel as the payoff function, i.e., 

fil(c) := (52) 

jeXi 
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We would like to point out that (15^ ean be reformulated to 

im{c) = (53) 

i.e., Q22 is a BSI game with Wij{ci, Cj) = — lcj=ci lij&e- Thus ^22] is an EPG. Note that this is 
a speeial ease of singleton CGs on graphs diseussed in Seetion IXI-Al 

As variations of G22l Xu et al. II193II diseussed the impaet of partially overlapped ehannels. 
Yuan et al. [|200B diseussed the variable-bandwidth ehannel alloeation problem. Zheng et al. 
[|209l took into aeeount stoehastie ehannel aeeess aeeording to the earrier sense multiple aeeess 
(CSMA) protoeol. Xu et al. 1119011 diseussed a multi-ehannel version of ^22l 
Liu et al. [I106II diseussed a eommon eontrol ehannel assignment problem for eognitive radios, 
and proposed using lcj=ci for the payoff funetion so that every player ehooses the same 
ehannel. This game is similar to the eonsensus game ^H1 

XL Channel Assignment to Enhance Throughput in Collision Channels 

Channels ean be viewed as eommon resourees in the eongestion model introdueed in Seetion 
IIII-B41 In general, throughput when using a ehannel depends only on the number of stations 
that seleet the relevant ehannel. A CG formulation is thus frequently used for ehannel seleetion 
problems. Altman et al. |l9l formulated a multi-ehannel seleetion game in a single eollision 
domain as a CG. Based on a CG formulation, ehannel seleetions by seeondary stations were 
diseussed in [f^ . [I189II . A ehannel seleetion problem in multiple eollision domains was diseussed 
in [11921 . lellamo et al. iTTSl used numerieally evaluated sueeessful aeeess probabilities depending 
on the number of stations in CSMA/CA as payoff funetions. 

Here, we diseuss ehannel seleetion problems in interferenee graph iX,£), where eaeh node 
i eX attempts to adjust its ehannel Cj to maximize its sueeessful aeeess probability or throughput. 

A. Slotted ALOHA 

Consider eollision ehannels shared using slotted ALOHA. Eaeh node i adjusts its ehannel to 
avoid simultaneous transmissions on the same ehannel beeause these result in eollisions. In this 
ease, when one node exelusively ehooses a ehannel, the node ean transmit without eollisions. 
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Thus, the following payoff function captures the benefit of nodes: 


^m{c) ;= 


1 if|Xf| = 0, 


(54) 


0 otherwise. 

Q2?> is a singleton CG on graphs, and Thomas et al. HI6911 showed that G23lis an OPgB 
Consider that each node has a transmission probability Xi (0 < Xj < 1). Chen and Huang 
[HTI proposed using the logarithm of successful access probability. 


i^(c) := log Xi Ujex^ii^ - 


(55) 


and proved that ^24 is a WPG. Here, we provide a different proof. When we consider 


t^(c) := - log(l - Xi) • v^{c) 

= - log(l - X,) log [x, n,v..(l - 
= -log(l-X,)log(Xi) 

- log(l - Xi) lij&s log(l - Xj), 


(56) 


^25 is a BSI game with Wij{ci,Cj) = — log(l — Xi) log(l — X^) lcj=ci lijes- Thus, G2n is a 
WPG and, by Theorem fTTl ^26 with payoff 


u|26l(c) := X, (57) 

is an OPG. Chen and Huang Il42l further discussed <3261 with player-specific constants and proved 
that the game is an OPG. 

Before concluding this section, we would like to point out the relationship between G24I and 
CGs. When we assume an identical transmission probability X* = X for every i, we get 


ul2l(c) = log(X) + log(l - X) lc,=Q lijes, 

i.e., <32nis a CG on graphs. 


(58) 


^There is another simple proof of this based on the fact that C I23l is equivalent to 0261 when setting Xi 


1 for every i. 
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B. Random Backojf 

Let the baekoff time of player i be denoted by A* e [1, A ma ^], where A^ax represents the 
baekoff window size. The probability to aequire ehannel aeeess is given by 


?i271(c) := Pr < Aj < min{A,} 


E 

A=1 


A. 


"^max ^ 
'^max 




(59) 


Q27 is a singleton CG, and thus is an EPG. Furthermore, Q28 with 

ii28l(c) := lim iJ271(c) = 


Amax-^OO ' ' 1 + XljVi lc^=Ci 


(60) 


is also a singleton CG. 

Chen and Huang ll40ll showed that G27I with player-specifie eonstants is an OPG. They [l42l 
further discussed C HT] and G28] on graphs with player-specific constants, and proved that these 
are OPGs according to the proof provided in [I120L Xu et al. [11941 further discussed the game 
under fading channels. 

Chen and Huang Il42l generalized <3281 to ^29, whose payoff function is a generalized through¬ 
put 


im{c) := 


Wi 




(61) 


where Wi (> 0) represents the channel-sharing weight for player i. Du et al. Il53l further discussed 
this kind of game. 

For the TX-RX pair model shown in Fig. [l Kb)| , Canales and Gallego Il26l proposed using the 
following network throughput as a result of joint transmission power and channel assignment as 
potential: 

G iiPi 


E 


Be- 


log2 1 -f 


N 


(62) 


1 + ^GijPj>T lcj=ci 

where Gij ^ Gji, Bc^ is the bandwidth of channel q, and T is the power threshold of interference. 
Since (l62l) is too complex, it may be difficult to derive simple payoff functions. Thus, Canales 
and Gallego proposed using payoff functions of the form of a WLU (|2^ . Note that the evaluation 
of the WLU of (l62l) requires the impact of joint assignment on the throughput of neighboring 
nodes. 
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XII. Transmission Probability Adjustment for the Multiple-access Collision 

Channel (Slotted ALOHA) 

Consider a collision channel shared using slotted ALOHA. Each node i adjusts its transmission 
probability Xi G [0,1] to maximize the following successful access probability (minus the cost): 

ul3Dl(xi, x_i) := Xi - ^j) - costj(xi). (63) 

This is a well-known payoff function. Further discussion can be found in [I167H . Because (1631) 
satisfies ([8]), CI3UI:= (X, ([0,1]), (tiSOl)) is an EPG with potential 

fW®) =-ni(l-2;i)-X;iCosti(a;i). (64) 

Candogan et al. ll^ showed that ^30 in stochastic channel model, where each player adjusts 
his/her transmission probability based on the channel state, is a WPG. Cohen et al. Il45l discussed 
a multi-channel version of G30I They also discussed G30I on graphs [l46ll . 

For this kind of transmission probability adjustment to satisfy ^ a:* < 1, the cost function 
costj(a3) = needs to be used llSOll . Because this cost function is a coordination function, 

a game with this cost function is still an EPG. 


XIII. Transmission Power Assignment to Enhance Throughput in 

Multiple-access Channel 


Here, we discuss power control problems in multiple-access channels, as shown in Fig. [l|{a) 


where each TX attempts to adjust its transmission power level to maximize its throughput. For a 
summary of transmission power control, we refer to ll43ll . Note that Saraydar et al. [I153H applied 
a game-theoretic approach to an uplink transmission power control problem in a CDMA system. 
The relation between potential games and transmission power control to achieve target SINK or 
target throughput has been discussed in II133H . 

Alpcan et al. 0 formulated uplink transmission power control in a single-cell CDMA as the 
game ^31 . (X, (X*), ('d31t, )), where Xj . { Pi I 0 ^ .Pi,min ^ Pi ^ Pi,max}’j Pi,min is the 

minimum transmission power, and Pj,max is the maximum transmission power. In this game, 
each TX / G X adjusts its transmission power pi G P, to maximize its data rate (throughput), 
which is assumed to be proportional to the Shannon capacity, minus the cost of transmission 
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power, i.e., 


■= log 



(65) 


where S (> 1) is the spreading gain and a* is a positive real number. The cost function —atpi is 
used to avoid an inefficient Nash equilibrium, where all TXs choose the maximum transmission 
power. All TXs choose this power because BR(p_j) is the maximum transmission power for 
every TX when the cost function is not used |I71, II153L 

Alpcan et al. [|7]| proved the existence and uniqueness of a Nash equilibrium in the game, and 
Neel II137[ §5.8.3.1] showed that this game is not an EPG because ([8]) does not hold. Note that 
Neel et al. 013211 was the first to apply the potential game approach to this type of power control. 
Instead of Q?>11 Fattahi and Paganini [l60l proposed setting 5” = 1 in GMl i.e.. 



( 66 ) 


log {N + GiPi) - log (^N + GjPj^ - costi(pi), 


where costj: Pj —)■ M is a non-decreasing convex cost function. Since 7i3^(p) is a linear com¬ 
bination of a coordination function log(^. GiPi -f cr^), a dummy function log(^^y • GjPj + a^), 
and a self-motivated function costi(pj), ^32]:= (X, (Pj), (rJ32l)) is an EPG with potential 


<432](p) = log {N + GiPi) - Ei costi(pi). 


(67) 


Because d H^ p) is continuously differentiable and strictly concave, by Theorem [3l there is 
a unique maximizer for the potential, and best-response dynamics converge to a unique Nash 
equilibrium, which is the maximizer of the potential on strategy space Kenan et al. [f8^ 

discussed ^32 over time-varying channels. 

Neel [I137[ §5.8.3.1] approximated (1651) by 



( 68 ) 


and showed that ^33 := (X. (P,). (?J33l)) is an EPG with potential d l33]( p) = Ej(legPi “ 
costj(pj)). Candogan et al. [[3Tll applied ^33] to multi-cell CDMA systems, and verified that the 
modified game is an EPG with a unique Nash equilibrium by applying Theorem [3l A more 
general form of payoff functions of SINK was discussed in lf65l . 
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A. Multi-channel Systems 

A transmission power control game ^32] with multiple channels was discussed in iTT?! . lIMll . 
[I1451 . Let the set of channels be denoted by C. Each TX i G X transmits through a subset of C 
to maximize the aggregated capacity 



(69) 


by adjusting the transmission power vector ... ,Pi,|c|)- This game is an EPG with potential 
log {Nc + Gi^cPi,c)- Mertikopoulos et al. 1112411 further discussed the game under fading 
channels. Note that multi-channel transmission power assignment problems can be seen as joint 
transmission power and channel assignment problems introduced in Section |K] because a zero 
transmission power level means that the relevant channel has not been assigned [I144L 

Note that [I145II also discussed BS selection, and further discussion can be found in fTSl . The 
joint transmission power and bandwidth assignment problem for relay networks was discussed 
in Primary-secondary scenario ll^ and heterogeneous network scenario UlOlll . I1181H . II2041I 
were also discussed. 

B. Preceding 

Closely related problems to the power control problems discussed above are found in precoding 
schemes for multiple-input multiple-output (MIMO) multiple-access channels. The instantaneous 
mutual information of TX i, assuming that multiuser interference can be modeled as a Gaussian 
random variable, is expressed as 


Blog, Im. + pHiQ,Hf + 


Blog, , (70) 


where p = 1/iV, Hi G is the channel matrix, iXf is the Hermitian transpose of iXj, 

Qi is a covariance matrix of input signal, is the number of antennas at every TX, and 


is the number of antennas at a single RX. Belmega et al. IfT^ discussed a game where an input 


covariance matrix Qi is adjusted. Concurrently, Zhong et al. 1121311 discussed a game where a 
precoding matrix is adjusted. Since Qi is calculated from a precoding matrix, these games are 
equivalent. 
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Since (TTOl) is a coordination-dummy function, this game is an EPG with the system’s achievable 
sum-rate as potential. This game was further discussed in W2\ Section 8]. Energy efficiency [I212II . 
primary-secondary scenario 1121411 . and relay selection II211II were also discussed. Joint precoding 
and AP selection in multi-carrier system was discussed in UlllL 


XIV. Transmission Power Assignment Maintaining Connectivity (Topology 

Control) 


The primary goal of topology control HI521 is to adjust transmission power to maintain network 
connectivity while reducing energy consumption to extend network lifetime and/or reducing 
interference to enhance throughput. 

Komali et al. lIMl formulated the topology control problem in the TX network model shown 


in Pig. [1 1(0)1 as ^34 := (X, {Vi), (ulMl)) with P* = [0, P,max] and 


i(3l(p) := afiip ) - Pi , 


(71) 


where a > maxj{Pj max}, and /i(p) is the number of TXs with whom TX i establishes (possibly 
over multiple hops) a communication path using bidirectional links. Note that fi{p'i,p^ -^) > 
fi{Pi,P-i) when p' > Pi. This game has been shown to be an OPG with 

<Mp) = a'^fi{p)- '^Pi- (72) 

i i 

Note that the mathematical representation of fi{p) using connectivity matrix 1120111 was first 
proposed in II127II . 

Komali et al. lIMll also discussed interference reduction through channel assignment, which is 
seen as a combination of G14I and a channel assignment version of G34I They further discussed 
the impact of the amount of knowledge regarding the network on the spectral efficiency |[^ . 

Chu and Sethu [|44| considered battery-operated stations and formulated transmission power 
control to prolong network lifetime while maintaining connectivity as an OPG. Similar ap¬ 
proaches can be found in If6^ . and the joint assignment of transmission power and channels was 
discussed in llTOll . 

Eiu et al. II103II . HI0411 formulated measures for transmission power and sensing range adjust¬ 
ment to enhance energy efficiency while maintaining sensor coverage as an OPG. 
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XV. Flow and Congestion Control in the Fluid Network Model 


Ba§ar et al. |I61, [fT^ formulated a flow and congestion control game, where each user i adjusts 
the amount of traffic flow r* to enhance 


ijl35l(r) := a* log(l + r^) - /Svi -—, (73) 

capacity — 2 _^- r* 

where 1/{capacity — represents the commodity-link cost of congestion. Because (17^ is 

a combination of self-motivated and coordination functions, a game ^35 with payoff function 
u|35l(r) is an EPG [[l7l]| with 


^ {tti log(l -f Ti) - f3ri) - 


(74) 


capacity — ^ • r. 

The learning process of this game was further discussed by Scutari et al. [I155H . Other payoff 
functions for flow control were discussed in [|58l . lllOOl . 


XVI. Arrival Rate Control eor an M/M/1 Queue 


Douligeris and Mazumdar ll52]| . and Zhang and Douligeris [I205H introduced an M/M/1 queuing 
game ^36 := (X, (Aj), (ti36l)). where each user i transmits packets to a single server at departure 
rate p and adjusts the arrival rate A* to maximize the “power” II113L which is defined as the 
throughput Xi divided by the delay p — Xi, i.e.. 


ij36l(A) := A"‘ 



(75) 


where «* (> 0) is a factor that controls the trade-off between throughput and delay. Note that 
this game is a Cournot game (see Q) when a* = 1 for every i. 

Gai et al. If62l proved that G36] is an OPG. Here, we provide a different proof. Because a 
game with payoff function M37i(A) = ctj log(Ai) -f log {p — Xi) is an EPG, by Theorem fTTl 
(X, (A), (exp(ii37l))) = (X, (Ai), («)) = 036] is an OPG. 


XVII. Eocation Update for Mobile Nodes 

A. Connectivity 

Marden et al. HUSH pointed out that the sensor deployment problem (see [l34ll and references 
therein), where each mobile node i updates its location r* G to forward data from immobile 
sources to immobile destinations, can be formulated as an EPG. Since the required transmission 
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power to an adjacent node j G Xj is proportional to the square of the propagation distance, 
||rj — rill, in a free-space propagation environment, minimizing the total required transmission 
power problem is formulated as a maximization problem with global objective 


-rjll^ (77) 

j&ii 

is used as the payoff function of node i, G38 := (X, (M^), (d38l)) is equivalent to the consensus 
game ^ 


B. Coverage 


A sensor coverage problem is formulated as a maximization problem with global objective in 
continuous form 039(s) |[34ll 


(im^) 

or in discrete form I1128H 


R{r) 


1 - 


dr, 


cHOfg) := ^ R{r) 

r 


1 


JJ(1 -Pi(r, Si)) 


(78) 


(79) 


where fl C is the specific region to be monitored, R\ VL ^ R+ is an event density function 
or value function that indicates the probability density of an event occurring at point r G 17, 
Pi: 17 X 17 —>■ [0,1] is the probability of sensor i to detect an event occurring at r G 17, and 
Sj G 17 is the location of sensor i. For a summary of coverage problems, we refer the interested 
reader to |l32l, lf33l . 

Arslan et al. uni discussed a game where each mobile sensor i updates its location s* G D, 
treated dliOfs) as potential, and proposed assigning a WLU to each sensor, i.e.. 


r 

where pi{r,Si) ~ corresponds to the probability that sensor i detects an event 

occurring at r alone. Further discussion can be found in [I115II . We would like to note that 


DRAFT 


June 29, 2015 











29 


Q40 := (X, (f2), (?j|lQl)) has a similar expression with ( ^301 In the same manner in C I40[ Diirr et 
al. [l57l treated dl39lsi as potential and proposed assigning a WLU 


ij|39l(s) = / R(r)pi(r,Si) 


m 


n(l -Pj(r, Sj)) 

■j¥=i 


dr. 


(81) 


Zhu and Martinez [I215H eonsidered mobile sensors with a direetional sensing area. Eaeh 
mobile sensor updates its loeation and direetion. The reward from a target is fairly alloeated to 
sensors eovering the target. 

Arsie et al. [|T2ll eonsidered a game where eaeh node i attempts to maximize the expeeted 
value of the reward. Here, eaeh node i reeeives the reward if node i is the first to reaeh point 
r, and the value of the reward is the time until the seeond node arrives, i.e.. 


:= / i?(r) max < 0, min||r 

Jn I 

^41 := (X, (H), (dmi) was proved to be an EPG. 



(82) 


XVIII. Channel Assignment to Enhance Coverage eor Immobile Sensors 


Ai et al. [[2l| formulated a time slot assignment problem for immobile sensors, whieh is 
equivalent to a ehannel alloeation problem, as ^42 := (X, (C*), (iM2l) ). where eaeh sensor i e X 
seleets a slot q G C* := {1,..., A"} to maximize the area eovered only by sensor i, i.e.. 


ill(c) := 


\ U jA* 5 


(83) 


Cj —Ci 

where Si is the sensing area eovered by sensor i. Game G42I was proved to be an EPG with 
potential 


c = 


K 

E 

k=l 


U iei <Si 

Ci=k 


(84) 


where (j){c)/K eorresponds to the average eoverage. 

To show the elose relationship between the payoff funetions (1631) in the slotted AEOHA game 
GSOland (IMl) in the eoverage game G39l we provide different expressions. Using pi{r) := 
we get 


lill(c) = / pi{r) JJ(1 - pj{r) lc,.=cj dr, (85) 

where the surfaee integral is taken over the whole area. Wang et al. [I180H further diseussed this 
problem. 
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Song et al. HI6411 applied the eoverage game to eamera networks. Ding et al. IfSTI diseussed a 
pan-tilt-zoom (PTZ) eamera network to traek multiple targets. Another potential game-theoretie 
PTZ eamera eontrol seheme was proposed in 1173 . motivated by natural environmental moni¬ 
toring. Direetional sensors were diseussed in ||951 . The form of payoff funetions is similar to 
([801). 

Until now, eaeh immobile sensor was assumed to reeeive a payoff when it eovered a target 
alone. Yen et al. II197II diseussed a game where eaeh sensor reeeives a payoff when the number 
of sensors eovering a target is smaller than or equal to the allowable number. Sinee this game 
falls within a elass of CGs, it is also an EPG. 

XIX. Conclusions 

We have provided a eomprehensive survey of potential game approaehes to wireless networks, 
ineluding ehannel assignment problems and transmission power assignment problems. Although 
there are a variety of payoff funetions that have been proven to have potential, there are some 
representative forms, e.g., BSI games and eongestion games, and we have shown the relations 
between representative forms and individual payoff funetions. We hope the relations shown in 
this paper will provide insights useful in designing wireless teehnologies. 

Other problems that have been formulated in terms of potential games are found in routing 

m, m, uni, umii, mb, urn, bs/ap seieedon m, m, mu, mm, uni, eooperative 

transmissions [|4||, II139L seereey rate maximization ifTTll . eode design for radar [I146H . broadeast¬ 
ing [l35ll . speetrum market IIFTl . network eoding II116L I1147L [I148L data eashing [|94ll . soeial 
networks [l39l . eomputation offloading [l38l . loealization ll79l . and demand-side management in 
smart grids [iTTl . II1831I . 
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